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APPARATUS AND METHOD FOR PREVENTING UNAUTHORIZED USE OF 
AN INFORMATION PROCESSING DEVICE 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to an information processing 
device having speech input and processing functions and in 
5 particular to a technique of preventing unauthorized use of 
the information processing device* 

2. Description of the Related Art 

•With the higher performance of a microprocessor, 
information processing devices are going multifunctional . For 

10 example, a personal-information management function (e.g. 
address book) may be provided for almost all portable 
communication devices such as portable telephone devices and 
PDA (Personal Digital Assistant) devices. In addition, users 
can obtain chargeable services through such portable 

15 communication devices or personal computers connected to the 
Internet. 

When such a portable communication device has fallen into 
the hands of an unauthorized person/ the unauthorized person 
can easily access not only the important personal information 
20 of the authorized user but also chargeable services. 

Accordingly, there have been proposed several security 
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techniques of preventing the unauthorized use of an information 
processing device . 

A common measure against the unauthorized use is to prompt 
a user to enter a preset password such as a string of alphanumeric 
5 characters. Only when an input password is identical to a 
previously registered password, the identity of a user is 
confirmed, thereby permitting the user to use this device - 
Typically a keypad or keyboard may be used to enter a password. 

Alternatively, Japanese Patent Application Unexamined 

10 Publication No. 2001-156884 discloses a portable telephone 
device having speech input and analysis functions to identify 
the authorized user through voice input. More specifically, 
a voice pattern of the authorized user is previously registered 
and is compared with an input voice pattern. When the input 

15 voice pattern is identical to the registered voice pattern, 
the portable telephone device starts ringing to notify the user 
where it is. Such a voice input technique may be employed to 
enter a password. 

However, the password key-input method cannot reliably 

20 identify who enters the password. In the case of the above 
voice input method, the user must repeatedly sound out the 
previously registered voice pattern, increasing the 
possibility of another person knowing the password , A malicious 
person may mimic or record the voice of the authorized user. 

25 Accordingly, the prior art cannot ensure security against the 
unauthorized use of cin information processing device . Although 
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the password may be changed, frequently changing a password 
becomes burdensome to a user. 



An object of the present invention is to provide a security 
5 enhancement apparatus and method of reliably preventing the 
unauthorized use of an information processing device without 



According to the present invention, an unauthorized use 
prevention apparatus included in an information processing 

10 device, includes: a speech feature memory storing identifying 
speech feature data previously obtained from voice of an 
authorized user; a password generator for generating a password 
which is a string of arbitrary characters; a password notifying 
section for notifying a present user of the generated password; 

15 a speech feature extractor for extracting speech feature data 
from voice of the present user to produce input speech feature 
data; a speech feature comparator for comparing the input speech 
feature data to the identifying speech feature data to produce 
a speech feature comparison result.; a password comparator for 

20 comparing an input password obtained from the voice of the 
present user to the generated password to produce a password 
comparison result; and a controller for determining whether 
to inhibit the use of the information processing device, 



SUMMARY OF THE INVENTION 



burdening a user with operations. 
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depending on the speech feature comparison result and the 
password comparison result. 

The generated password is preferably renewed each time 
the information processing device is put to use. 
5 The unauthorized use prevention apparatus may further 

include: a database storing a plurality of entries, each of 
which includes address information accompanied with a password, 
check flag, wherein, when a request operation occurs, the 
controller searches the database for address information 
10 related to the request operation and, when the password check 
flag accompanying the address information found indicates that 
password check is needed, starts an unauthorized use preventing 
operation. 

As described above, an arbitrary password is generated 
15 and a user is notified of the generated password. The user 
sounds out the password to enter a voice signal of the password. 
The voice signal of the password is verified with respect to 
both speech feature and password itself to determine whether 
an unauthorized person uses the information processing device. 
20 Since a password to be sounded out by a user is not fixed 

' but changeable or arbitrary, it is very difficult for another 
person to imitate the voice of the authorized user and actually 
impossible to abuse the recorded voice of the authorized user. 
Further, since a password is changed automatically, there 
25 is no need of the user manually changing the password. 

Since a single voice input of a password is verified with 



2004 03/18.* 14:36 FAX 03 3288 3222 Katsuragi Patent -h* FOLEY & LARDNER 



©013/037 



FQ5-622 5 

respect to not only password itself but also speech feature, 
it is possible to precisely identify an authorized user with 
such a very simple operation that the user sounds out a generated 
password, resulting in further enhanced security. 
5 Since a password generated is renewed each time the 

information processing device is used, the security is ensured 
even though unauthorized use attempts are repeatedly made. 

In addition, a plurality of registered addresses are 
selectively subjected to password check operation depending 
10 on user's setting. Accordingly, there is no need of the user 
entering the password for all addresses. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a portable telephone 
device employing an unauthorized use prevention apparatus 
15 according to a first embodiment of the present invention; 

Fig. 2 is a flowchart showing an unauthorized use 
preventing operation according to the first embodiment of the 
present invention; 

fig. 3 is a diagram showing an example of a generated 
20 password displayed on screen; and 
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Fig. 4 is a flowchart showing an unauthorized use 
preventing operation according to a second embodiment of the 
present invention; 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

5 In this description, taking a portable telephone device 

as an example of an information processing device, preferred 
embodiments of the present invention will be described. 

1 . First Embodiment 

Referring to Fig. 1, a portable telephone device 10 

10 according to a first embodiment of the present invention is 
provided with a controller 11 which controls the whole operation 
of the portable telephone device 10, including an unauthorized 
use prevention control. The controller 11 may be a 
program-controlled processor such as a DSP (Digital Signal . 

15 Processor) , on which control programs run as described later. 

The portable telephone device 10 is further provided with 
a radio system 12 and a speech processor 13, which are used 
for voice and data communication through radio channels under 
control of the controller 11. 

20 The speech processor 13 has a speaker (telephone-receiver) 

13A and a microphone (telephone-transmitter) 13B connected 
thereto. In the case of telephone communication, input voice 
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received by the microphone 13B is subjected to speech coding 
for transmission through the radio system 12 ♦ In the case of 
user identity verification, input voice received by 
the microphone 13B is converted into digital and output to an 
5 unauthorized use preventing section as described hereinafter* 
The unauthorized use preventing section includes a speech 
feature extractor 14, a speech feature memory 15, a speech 
feature comparator 16, a password generator 17, and a password 
comparator 18. 

10 The speech feature extractor 14 has a function of 

extracting speech feature data from an input voice signal- 
received from the speech processor 13. The speech feature data 
represents the voice features of individuals. In the case of 
speech feature registration of an authorized user, the speech 

15 feature data is output to the speech feature memory 15. In 
the case of user identity verification, the- speech feature data 
is output to the speech feature comparator 16. 

The speech feature data is biometric information extracted 
from human voice, like fingerprint or palm print, which can 

20 be obtained by well-known identity verification techniques. 
For example, a voiceprint can be used as a speech feature, which 
is an individually distinctive pattern of certain voice 
characteristics that is spectrographically produced. 

The speech feature memory 15 previously stores an 

25 identifying speech feature data, which is the speech feature 
data of an authorized user. 
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The speech feature comparator 16 compares input speech 
feature data to the identifying speech feature data stored in 
the speech feature memory 15* 

The password generator 17 has a function of generating 
5 an arbitrary password based on a random number. Therefore, 
the password generator 17 generates a renewed password each 
. time the portable telephone device 10 is put to use. 

The password comparator 18 compares the password generated 
by the password generator 17 to an input password recognized 
10 from the input voice signal received from the speech processor 

A password generated in the present embodiment may be 
a string of alphanumeric characters, which may include Japanese 
Kana or Chinese characters. The password generator 17 may 
15 randomly select a password from a plurality of passwords, which 
are previously stored in a memory* In this case, a meaningful 
word or phrase is preferably used as a password, resulting in 
reduced possibility of erroneously entering a password by voice 
input.. 

20 . Alternatively, a password can be generated without 

the need of preparing a plurality of passwords. In this case, 
the password generator 17 generates a password by randomly 
selecting a string of characters from a plurality of characters * 
Since a generated password is not always meaningful , the security 

25 is made higher. It is possible to combine a randomly 

selectedmeaningf ul string of characters and a randomly selected 
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characters to generate a password. 

In the password comparator 18, a well-known speech 
recognition technique can be used- The password comparator 
18 may use speech signals/feature data or text data of passwords 
5 for password comparison- In the case of password comparison 
based on speech signals/feature data, the password generator 
17 generates a password as speech signal/feature data. The 
password comparator 18 compares the speech signal / feature data 
of the generated password to the input speech signal/feature 

10 data of the input password to determine whether input password 
is identical to the generated password. 

In the case of password comparison based on text data, 
the password comparator 18 translates an input speech signal 
into text data by using the well-known speech recognition 

15 technique and then compares it to the generated password. 

The unauthorized use preventing section as described 
above needs high-speed processing of a large amount of data. 
Accordingly, the speech feature extractor 14 , the speech 
f eaturememory 15, the speech feature comparator 16, the password 

20 generator 17, and the password comparator 18 may be implemented 
in a dedicated microprocessor. Programs running on a DSP may 
implement at least part of the unauthorized use preventing 
section. Alternatively, when the controller 11 has a high level 
of performance, at least part of the unauthorized use preventing 

25 section can be implemented in the controller 11. 

The portable telephone device 10 is further provided with 
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a key input section 19 and a display 20. The key input section 
19 has a function of detecting operations of various keys 
including ten-key, menu key and function key. 

The display 20may be a liquid-crystal display (LCD) device, 
5 which displays necessary information and images on screen under 
the control of the controller 11. in the present invention, 
the display 20 has a function of notifying a user of a password 
generated by the password generator 17 . The generated password 
is displayed by the display 20 so that the user sounds out it. 

10 The password notifying means is not limited to the display 

20. Any means of notifying the user may be employed. For 
example, the controller 11 produces a voice synthesis signal 
from a generated password and controls the speech processor 
13 to sound out the generated password from the speaker 13A. 

15 The memory 21 stores programs 21A to be executed on the 

controller 11 and necessary data for the processes. The 
programs 21A include a security enhancement program, or an 
unauthorized use preventing program, according to the present 
invention. The necessary da ta includes , for example, an address 

20 book, which is a database for retrieving a destination address 
or telephone number. The programs 21A may be written onto a 
ROM and the ROM is inserted to the portable telephone device 
10. The programs 21A may be written onto the memory 21 through 
the controller 11 from outside* Alternatively, the programs 

25 21A may be installed into the memory 21 by downloading them 
from a program delivery server on a data communication network 
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through a radio channel . 

Next, an unauthorized use preventing operation of the 
portable telephone device 10 will be described with reference 
to Figs. 2 and 3. 
5 1.1) Registration 

First, the authorized user sets the portable telephone 
device 10 to a voice registration. mode and then registers the 
identifying speech feature data onto the speech feature memory 
15. For example, the user sounds out various alphanumeric 
10 characters and/or a plurality of predetermined words or phrases 
so that the speech processor 13 inputs voice signals from 
the microphone 13B. The speech processor 13 discriminates 
various voice signals to output them to the speech feature 
extractor 14 . The speech feature extractor 14 extracts a speech 
15 feature from each voice signal and stores them as identifying 
speech feature data into the speech feature memory 15. 
1.2) Permission/Inhibition Judgment 

It is assumed that a user wishes to use the portable 
telephone device 10 to make a call. When the user operates 
20 the keypad to make a call, the key input section 19 detects 
the call request operation and informs the controller 11. In 
advance of actual calling instruction, the controller 11 
performs the unauthori zed use preventing operation to determine 
whether the call request is to be permitted or inhibited, as 
25 shown in Fig. 2. 

Referring to Fig. 2, the controller 11 determines whether 
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the identifying speech feature data has been registered in the 
speech feature memory 15 (step 101) . When the identifying 
speech feature data is stored (YES in step 101) , the controller 
11 instructs the password generator 17 to generate a renewed 
5 password (step 102) . Subsequently, the controller 11 instructs 
the display 20 to display the generated password and an 
instruction for speaking it on screen as shown in Fig. 3 (step 
103) . In the example of Fiq. 3, the generated password is "Good 
Morning" and the user is prompted to sound out "Good Morning". 

10 Thereafter, the controller 11 waits for user ' s voice input 

(step 104). When receiving voice input detection from the 
speech processor 13 (YES in step 104) , the controller 11 
instructs the speech processor 13 to output the detected voice 
signal to the speech feature extractor 14 and the password 

15 comparator 18. The speech feature extractor 14 is instructed 
to extract speech feature data from the input voice signal and 
outputs it as input speech feature data to the speech feature 
comparator 16 (step 105) . 

The speech feature comparator 16 is instructed to compare 

20 the input speech feature data to the identifying speech feature 
data stored in the speech feature memory 15 (step 106). 

When the input speech feature data matches the identifying 
speech feature data (YES in step 106), the controller 11 
instructs the password comparator 18 to compare the input 

25 password recognized in the input voice signal to the generated 
password received from the password generator 17 (step 107) . 
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When the input password is identical to the generated 
password (YES in step 107) , it is determined that the input 
voice is the voice of the authorized user and the input password 
is the generated password. Accordingly, the controller 11 
5 determines that the present user is the authorized user and 
therefore the present user is permitted to use this portable 
telephone device 10 (step 108) . 

When the input speech feature data does not match the 
identifying speech feature data (NO in step 106) or when the 

10 input password is not identical to the generated password (NO 
in step 107) , the present user is not verified and therefore 
the present user is inhibited to use this portable telephone 
device 10 (step 109) „ In the case where no identifying speech 
feature data is stored in the speech featiare memory 15 (NO in 

15 step 101), the present user is not verified and therefore the 
present user is also inhibited to use this portable telephone 
device 10 (step 109) . 

When the user is permitted to use the portable telephone 
device 10 (step 108) , the controller 11 accepts the user' s input 

20 of a telephone number through the key input section 19 and then 
instructs the radio system 12 to start making a call at the 
telephone number . 

When the user is inhibited to use the portable telephone 
device 10 (step 109), the controller 11 does not accept any 

25 user's input operations and displays a message indicating that 
the use is inhibited on screen. Alternatively,, an alert may 
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be generatedby the speech processor 13 and sounded by the speaker 
13A to notify the user. 

As described above, an arbitrary password is generated 
and the present user is notified by the display 20 or the speaker 
5 13A of the password. The user sounds out the password to enter 
a voice signal of the password . The unauthorized use preventing 
section verifies the voice signal of the password with respect 
to both speech feature and password itself to determine whether 
an unauthorized person uses the portable telephone device 10. 

10 Since a password to be sounded out by a user is not fixed 

but changeable, it is very difficult for another person to 
imitate the voice of the authorized user and actually impossible 
to abuse the recorded voice of the authorized user. Further , 
since a password is changed automatically, there is no need 

15 of the user manually changing the password. 

Since one voice input of a password is verified with respect 
to not only password itself but also speech feature, it is 
possible to precisely identify an authorized user with such 
a very simple operation that the user sounds out a generated 

20 password, resulting in further enhanced security- 

Since a renewed password is generated each time the 
portable telephone device 10 is used, the security is ensured 
even though unauthorized use attempts are repeatedly made. 

It should be noted that the speech feature check steps 

25 106 and the password check step 107 can change their places 
in the flow as shown in Fig. 2. In the above embodiment, the 
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generated password is entered through voice input before 
entering telephone number. It is possible to enter the 
telephone number before entering the generated password. 

The comparison system of speech feature and password is not 
5 limited to a certain system- A generated password may be 
arbitrarily determined. Japanese . alphabets "a, i, u, e, 
o", numerals "1, 2, 3, 4, 5", English alphabets "a, b, c, d, 
e" or an arbitrary combination of these characters may be used. 

The user is notified of a generated password by displaying 
10 through the display 20 or by sound through the speaker 13A. 
Any other means of notifying the user of a generated password may* 
be employed. 

In the present embodiment:/ the function of preventing 
unauthorized use has been described taking the case of making 

15 a call as an example. It is apparent that the present invention 
can be applied to any operation performed by a user. 

For example, in the case of incoming call or e-mail, the 
user usually takes the call by operating an off-hook key or 
accesses the mailbox by operating appropriate keys . According 

20 to the present invention, however, these operations are valid 
only when it is determined that the use is permitted (step 108) 
as shown in Fig. 2. If the use is inhibited (step 109), then 
the off-hook or mailbox access operations are all invalid and 
a message indicating that the use is inhibited is displayed 

25 on screen or an alert may be made by the speaker 13A. 
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2 . Second Embodiment 

As described before, the portable telephone device 10 
is provided with the memory 21 storing an address book 21B (see 
Fig. 1). The address book is a database capable of managing 
5 address information, which contains entries each composed of 
telephone number, person' s name and other information related 
thereto. 

According to a second embodiment of bhe present invention, 
each entry of the address book further contains a password check 

10 flag in addition to the above address information. A password 
check operation is performed depending on whether a 
corresponding password check flag is set. Assuming that the 
password check flag of an entry has been set, the password check 
is performed when a telephone number is read from that entry 

15 of the address book for making a call. The details will be 
described hereinafter. 

As shown in Fig. 3, the controller 11 determines whether 
a telephone number for making a call is entered through the 
key input section 19 (step 201) . Here, if the telephone number 

20 is entered by the user operating the keypad (YES in step 201) , 
then it is determined that the present user is permitted to 
user this device 10 (step 218) and the unauthorized use 
preventing control is terminated. 

Contrarily, when the key input is not used to enter the 

25 telephone number (NO in step 201), the controller 11 further 
determines whether the telephone number is read from the address 
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book (step 202). If not (NO in step 202) , the control goes 
back to the step 201 to wait for telephone number input- 

When the telephone number is read from the address book 
(YES in step 202) , the controller 11 searches the address book 
5 for setting information corresponding to the read 

telephone number. By looking at the password check flag 
included in the found setting information, it is determined 
whether the password check for that telephone number is needed 
(step 203) . 

10 When the password check flag has been reset, that is, 

the password check is not needed (NO in step 203) , it is determined 
that the present user is permitted to user this device 10 (step 
218) and the unauthorized use preventing control is terminated. 

When the password check flag has been set, that is, the 

15 password check is needed (YES in step 203), the .controller 11 
performs the following steps 211-219, which are the same as 
the steps 101-109 of Fig. 2. Accordingly, descriptions of the 
steps 211-219 are omitted. 

As described above, when a user uses the address book 

20 to make a call at a telephone number with its password check 
flag being set, in advance of actual calling instruction, the 
controller 11 performs the unauthorized use preventing 
operation to determine whether the call request is to be 
permitted or inhibited. 

25 Accordingly, only when the password check flag of a 

registered telephone number is set, the controller 11 starts 
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the unauthorized use preventing operation to determine whether 
the operating user is permitted to use the device 10. Since 
password check flags can be selectively set depending on 
destinations , the user is not always prompted to enter a password, 
5 resulting in reduced inconvenience to the user. 

In Fig. 4, at the step 201, if the telephone number is 
entered by the user operating the keypad, then it is determined 
that the present user is permitted to user this device 10 (step 
218) . The present invention is not limited to this control 

10 flow. In the case of key input, the control may unconditionally 
goes to the use inhibition step 219 or to the step 211 as described 
in the first embodiment, resulting in enhanced security. 

Similarly, in the case where the password check 
is not needed (No in step 203) , the control may unconditionally 

15 goes to the use inhibition step 219, resulting in enhanced 
security. 

As described in the first embodiment, the second 
embodiment is not only applied to the case of making a call 
but also any operation performed by a user. In the case of 

20 incoming call or e-mail, the user usually takes the call by 
operating an off-hook key or accesses the mailbox by operating 
appropriate keys. 

According to the second invention, however, when a use 
takes an incoming call or mail, the controller 11 searches the 

25 address book for the address information (here, source 
telephone number or source IP address) of the call or 
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incoming mail. When a match is found, the controller 11 looks 
at. the password check flag of the source telephone number or 
address and, only when the password check flag of the calling 
telephone number or source address is set, the controller 11 
5 starts the unauthorized use preventing operation to determine 
whether the operating user is permitted to use the device 10. 
The off-hook or mailbox open operation is valid only when it 
is determined that the use is permitted (step 108) as shown 
in Fig. 4 . If the use is inhibited (step 109) , then the off-hook 
10 or mailbox access operations are all invalid and a message 
indicating that the use is inhibited is displayed on screen 
or an alert may be made by the speaker 13A. 

In the above-described first and second embodiments, a 
portable telephone device is taken as an example. The present 

15 invention is not restricted to the portable telephone device. 
As described before, the present invention can be applied to- 
any information processing device equipped with a microphone 
and a display, that needs security management against accessing 
chargeable services or reading personal information, for 

20 example, wired telephone equipment, personal computer, 
portable information device such as PDA and the like. 



